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STREAMING MEDIA BUFFERING SYSTEM 

BACKGROUND OF THE INVENTION 

This application is a continuation of Application Serial Number 09/819,377, filed 
March 28, 2001, entitled Streaniing Media Buffering System, the disclosure of which is 
hereby incorporated in its entirety by reference thereto. 

1. Field of the Invention 

The present invention relates to multimedia computer communication systems; and 
more particularly, to a buffering system for streaming media, such as audio/video, on the 
Internet. 

h Description of tlie Prior Art 

Prior to the development of Internet streaming media technologies, audio and video 
were formatted into files, which users needed to download to their computer before the files 
could be heard or viewed. Real time, continuous media, as from a radio station, was not 
suitable for this arrangement in that a file of finite size must be created so it could be 
downloaded. The advent of streaming media technologies allowed users to listen or view the 
files as they were being downloaded, and allowed users to "tune-in" to a continuous media 
broadcast, or "stream", such as from a radio station. 

Since audio and video me dia must play out over a period of time it is more 
appropriate to think of bandwidth requirements than file size. The bandwidth requirement of 
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an audio or video media refers to the data rate in bits per second that must be transmitted and 
received in order to listen or view the material uninterrupted. Transmitting the audio or 
video material over a connection slower than the bandwidth requirement results in 
unsatisfactory viewing or listening, if viewing or listening is possible at all. The connection 
S available to most Internet users is by dial-up modem, which has a maximum receive data rate 
of 56,000 bits per second. Most audio and video available on the Internet has been 
compressed to be listenable or viewable within the 56,000 bits per second modem 
bandwidth. Requirements for achieving adequate audio and video over the Internet generally 
consume a considerable portion of the available bandwidth. 

10 Internet connection quality can vary rapidly over time, with two primary factors 

responsible for degradation of the instantaneous bandwidth actually available to the user. 
These factors are the quality of the user's modem connection over telephone lines, which 
can have periods of interference causing reduced available bandwidth, and momentary 
Internet congestion at various points along the route over which the user's data flows. Each 

15 of these factors can cause delays and interruptions in the transmission of data to the user. 
Internet data communications devices such as routers are designed to drop data '"packets" if 
they get overloaded. For material that is not time sensitive, these dropped packets will 
usually be resent, and the user will eventually be presented with the material. However, since 
streaming media is time sensitive, dropped packets can have a significant impact on the 

20 receipt and playback of an audio or video stream. These degradations in the receipt of 
Internet data are very common, and prevent most users from being able to listen to or view 
streaming media without interruption unless some special provisions have been incorporated 
into the user's computer software to accommodate data transmission interruptions. 
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These interruptions are commonly referred to as "dropouts", meaning that the data 
flow to the user has been interrupted (i.e., the audio "drops out"). Dropouts can be extremely 
annoying - for example, while listening to music. The current state-of-the-art solution to the 
problem uses a pre-buffering technique to store up enough audio or video data in the user's 
5 computer so that it can play the audio or video with a minimum of dropouts. This process 
requires the user to wait until enough of the media file is buffered in memory before 
listening or viewing can begin. The media data is delivered by a server computer which has 
available to it tiie source of the media data, such as by a connection to a radio station. When 
the user connects to the server via the Internet, audio/video output at the user's system is 

10 delayed while the user's buffer is filled to a predetermined level Typical pre-buffering wait 
times range from 10 to 20 seconds or more, determined by the vendor providing the audio or 
video media. Even with this pre-buffering process, interruptions in playback still occur. 

In this process, the user has a software application on the computer commonly called 
a "media player". Using the features built into the media player, the user starts the audio or 

15 video stream, typically by clicking on a "start" button, and waits 10-20 seconds or so before 
the material starts playing. During this time data is being received from the source and filling 
the media player's buffer. The audio or video data is delivered from the source at the rate it 
is to be played out. If, for example, die user is listening to an audio stream encoded to be 
played-out at 24,000 bits per second, the source sends the audio data at the rate of 24,000 

20 bits per second. Provided that the user waits 10 seconds, and the receipt of the buffering data 
has not been interrupted, there is enough media data stored in the buffer to play for 10 
seconds. 

Gaps in the receipt of audio/video data, due to Internet slowdowns, cause the buffer 
to deplete. Because transmission of audio/video media data to die user takes place at the rate 
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it is played out, the user's buffer level can never be increased or replenished while it is 
playing. Thus, gaps in the receipt of audio/video media data inexorably cause the buffer 
level to decrease from its initial level. In time, extended or repeated occurrences of these 
gaps empty the user's buffer. The audio/video material stops playing, and the buffer must be 
5 refilled to its original predetermined level before playing of the media resumes. 

By way of illustration in a 10 second pre-buffering scenario, if the data reception 
stopped the instant that the media started playing, it would play for exactly 10 seconds. Once 
it starts playing, the media data plays out of the buffer as new media data replenishes the 
buffer. The incoming data rate equals the rate at which the data is played out of the user's 

10 buffer, assuming the receipt of data across the Internet is unimpeded. If there are no 
interruptions in the receipt of the media data for the duration of the time the user listens to or 
watches the material, the buffer level remains constant and there will still be 10 seconds of 
data stored in the media player's buffer when the user stops the player. On the other hand, if 
the media player encounters interruptions totaling 6 seconds while playing the material, there 

15 would only be 4 seconds of media data remaining in the buffer when the user stopped it. If 
data reception interruptions at any time during the playing exceed 10 seconds, the user's 
media player buffer becomes exhausted. There is no media data to play, and the audio or 
video stops - a dropout has occurred. At this point a software mechanism in the media 
player stops attempting to play any more of the material, and starts the buffering process 

20 again. The media player remains silent until the buffer refills, at which time the media player 
will once again start playing the material. 

There are two fundamental types of streaming media: (i) material that originates from 
a source having a real-time nature, such as a radio or TV broadcast, and (ii) material that 
originates from a non-real-time source such as from a disk file. An example of non-real-time 
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material might be a piece of music stored as a disk file, or a portion of a broadcast that 
originally was real-time, perhaps yesterday's TV evening news, and was recorded into a disk 
file. For purposes of clarity within this document, streaming media of type (i) will be 
referred to as 'l^roadcast" media, and streaming media of type (ii) will be referred to as "file 
S based" media. 

Both streaming media types are handled similarly in conventional systems, and both 
are handled similarly by the streaming media buffering system of the present invention. The 
two streaming media types are readily distinguished. Broadcast streaming media has as its 
source a system or arrangement that by definition can only be transmitted to users as fast as 

10 the material is generated; for example, a disk jockey speaking into a microphone. File based 
media, on the other hand, can be transmitted to users at any data rate, since there is no 
inherent time element to a file residing on a computer disk. With conventional Internet 
streaming media systems for streaming media of either type, media data is transmitted from 
the server to the user at the rate at which it will be played out, regardless of the data rate 

1 5 capabilities of the connection between the server and the user. 

Conventional streaming media systems may buffer media data at the server for the 
purpose of packet assembly/disassembly. Media data may also be buffered at the server to 
permit programming conveniences such as dealing with chunks of data of a specific size. 
Server buffering of media data is not used by conventional streaming media systems to 

20 mitigate long term Internet performance degradation as described hereinafter. 

The sending of audio or video files via a network is known in the art. US Patent 
6,029,194 to Tilt describes a media server for the distribution of audio/video over networks, 
in which retrieved media frames are transferred to a FIFO buffer. A clock rate for a local 
clock is adjusted according to the fullness of the buffer. The media frames from the buffer 
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are sent in the form of data packets over the networks in response to interrupts generated by 
the local clock. In this manner, the timing for the media frames is controlled by the user to 
assure a continuous stream of video during editing. US Patent 6,014,706 to Cannon, et al. 
discloses an apparatus and method for displaying streamed digital video data on a cUent 
5 con5)uter. The client computer is configured to receive the streamed digital video data from 
a server computer via a computer network. The streamed digital video data is transmitted 
from the server computer to the client con^uter as a stream of video frames. US Patent 
6,002,720, to Yurt, et al. discloses a system of distributing video and/or audio information 
wherein digital signal processing is employed to achieve high rates of data compression. US 

10 Patent 5,923,655, to Veschi et al. discloses a system and method for communicating 
audio/video data in a packet-based computer network wherein transmission of data packets 
through the computer network requires variable periods of transmission time. US Patent 
5,922,048 to Emura discloses a video server apparatus having a stream control section which 
determines a keyframe readout interval and a keyframe playback interval that satisfy a 

15 playback speed designated by a terminal apparatus. Finally, US Patent 6,014,694 to Aharoni, 
et al. discloses a system and method for adaptively transporting video over networks, 
including the Internet, wherein the available bandwidth varies with time. 

There remains a need in the art for a method and system that afford immediate and 
uninterrupted listening/viewing of streaming media by the user. 

20 

SUMMARY OF THE INVENTION 
The present invention provides a system and method for sending streaming media, 
such as audio or video files, via the Internet. Immediate playing of the media on a user's 
computer is afforded while reducing interruptions in playback due to Internet congestion and 
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temporary modem delays due to noisy lines. Nearly instantaneous playback is achieved, 
while maintaining protection against playback interruption. Delayed starts, heretofore 
required to provide protection against interruption, are avoided. Data loss due to 
interruptions in the receipt of media data by the media player can be recovered while the 
5 player continues to play out the audio or video material. If the interruptions are so severe as 
to deplete the user's buffer and stop the play out, the media player will begin to play out 
again as soon as the media player begins to receive media data without waiting to first build 
up the buffer. 

Generally stated, the invention provides a system for distributing via the Internet 
10 streaming media composed of a plurality of time-sequenced data elements. The system has a 
server connected to the Internet for transmitting the data elements. Associated with the 
server are a buffer manager and a FIFO buffer for storing at least one of the data elements 
for transmission. The buffer manager comprises means for: receiving the media data; 
supplying media data in order to the FIFO buffer; supplying the FIFO buffer with a 
15 predetermined number of data elements at a constant time-sequenced fill rate; maintaining a 
pointer into the buffer for each user computer indicating the last media data element that has 
been sent to that user, thus indicating the next element or elements to be sent; and, once the 
FIFO buffer is full, deleting the oldest data element in the buffer as each new data element is 
received, said means arranged to maintain the pre-determined number of data elements in the 
20 FIFO buffer. At least one user computer is connected to the server via the Internet or other 
data communications medium. 

This invention presumes the existence of a data communications transport 
mechanism, such as the TCP protocol, for the reliable dehvery of data in an ordered 
sequence from the source of the media data to the server, or from the server to the media 
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player software of the user computer. Thus, the delivery of data in the proper sequence is 
outside the scope of this invention. 

The user computer is associated with a media player software incorporating a user 
buffer and confiprises means for receiving and storing a predetermined number of media data 
5 elements which are received sequentially by the media player, playing the data out 
sequentially as audio and/or video, and deleting media data elements from the buffer as they 
are played out As data is played out, the next sequential data elements are received from the 
server in such a fashion as to approximately maintain the predetermined number of data 
elements in the user's buffer. 

10 The server stores a predetermined amount of media data in a First-In First-Out 

(FIFO) buffer in an arrangement that receives media data at a fixed rate. Once ttie buffer is 
full, for each new data element received into the buffer the oldest data element is deleted 
from the buffer. Requests from user computers to connect are not accepted until the server 
buffer is full. Once a connection is made to a user's computer, the server sends the media 

15 data to the user computer as buffer in the following manner. First, media data is sent to the 
user at the highest rate that the data connection between the server and the user computer 
will support until the predetermined amount of data that had been stored in the server buffer 
has been transferred to the user's computer. Once the buffer has been transferred a steady 
state condition is reached wherein as each media data element arrives at the server, it is 

20 immediately sent out to the user computer. In this steady state condition, the media data is 
sent at a rate that matches the constant fill rate of the server buffer, and is received at the 
same rate by the user conputer if there are no interruptions in the transmission of media data 
between the server and the user's computer. If interruptions have interfered with the arrival 
of sent media data to the user's computer, that data may have been "dropped" by routers in 
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the Internet and needs to be resent. This causes data to '*back up" into the server FIFO for 
that user. 

The resending of missing data is the responsibility of the reliable transport 
mechanism, such as TCP. The server buffer "sends" data by delivering it to the transport 
5 mechanism. The transport mechanism actually "sends" the data across the communications 
medium, and has processes which determine if all the data that has been sent has been 
received by the destination. If not, missing pieces of data are automatically resent to the 
destination, and are arranged to be delivered to the target software on the destination system 
in an ordered fashion. In the circumstance of this invention, the destination is the user 

10 computer, and the target software on the destination system is the media player. If the 
transport mechanism determines that data is missing, it retransmits that data to the 
destination as fast as the connection between the server and destination will allow. The net 
effect of this invention is that all media data to be delivered to a user computer is always sent 
as fast as the communications medium will support, either by the server buffer passing media 

15 data to the transport mechanism, or by the transport mechanism delivering or redelivering 
the media data to the user computer. This is enabled by buffering data at the server, and is 
distinctly different from prior art in which media data is only sent from the server to the user 
conputer at the rate at which it is to be played out. 

Routinely, once a steady state has been achieved, the next data element to be sent is 

20 the next sequential data element from that which has akeady been received by the user's 
computer buffer. However, if there is more data to be sent than at the routine constant fill 
rate, such as in the condition where some media data has been resent by the reliable transport 
layer, the server transport mechanism will again send the buffered media data as fast as the 
connection between the server and the user's computer will support. This allows for 
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rebuilding the user's computer buffer under circumstances wherein Internet interruptions 
have blocked the normal flow of data. When compared to conventional systems, which 
provide no capability to rebuild the user's con^uter buffer when data is lost, the streaming 
media buffering system of the present invention provides for recovery of lost data elements 
5 and the restoration of the user's buffer, even while the user media player continues to play. 

Under conditions in which interruptions have interfered with the arrival of sent 
media data to the user's computer, data loss exceeding certain levels will cause the transport 
mechanism software to stop accepting data for transmission from the application software, 
namely the streaming media server software. The streaming media server software keeps 

10 track of the last data element in the FIFO buffer that has been "sent" to each user using a 
software pointer. An interruption in the ability to send media data to a user results in this 
pointer "backing up" in the FIFO in such a way that the server knows from what point in the 
buffer to restart sending data when the transport mechanism again requests data to send. 
When the server software receives that notification, it will begin sending data to the user 

15 starting from the next data element to send as indicated by the pointer, and sending as much 
data as the transport mechanism will accept The transport mechanism will again send this 
data as fast as it can to the user. This process continues until the steady state condition is 
again reached wherein each data element is sent to the user as soon as it arrives from the 
media source. 

20 In another embodiment, the server is connected to the Internet, and to a broadcast 

media source, such as a radio station. A radio station computer is provided with a means for 
receiving media data elements as they are generated by the audio and/or video source, and 
for transmitting those media data elements to the server at a constant time-sequenced rate, 
using a reliable transport mechanism such as TCP. As before, the server provides a buffer 
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manager and a FIFO buffer, and provides a means for receiving the sequentially arranged 
media data elements from the broadcast media source and storing those data elements in the 
FIFO buffer. The buffer manager comprises means for: supplying the FIFO buffer with a 
predetermined number of data elements at a constant time-sequenced fill rate; maintaining a 
5 pointer into tiie buffer for each user computer indicating the last media data element that has 
been sent to that user, thus indicating the next element or elements to be sent; and, once the 
FIFO buffer is full, deleting the oldest data element in the buffer as each new data element is 
received. Importantly, the buffer manager is arranged to maintain the pre-determined number 
of data elements in the FIFO buffer. At least one user computer is connected to the server via 

10 the Internet or other data communications medium. 

The user computer is associated with a media player software incorporating a user 
buffer and con5)rises means for receiving and storing a predetermined number of media data 
elements which are received sequentially by the media player, playing the data out 
sequentially as audio and/or video, and deleting media data elements from the buffer as they 

15 are played out As data is played out, the next sequential data elements are received from the 
server in such a fashion as to approximately maintain the predetermined number of data 
elements in the user's buffer. 

In another embodiment, the server is connected to the Internet and provisioned as 
initially described, and has available to it file based media data as the source material. The 

20 file based media data can be read by the server which can deliver media data elements to the 
server FIFO buffer at a constant time-sequenced rate, as if the data were arriving from a 
broadcast media source. As before, the server provides a buffer manager and a FIFO buffer, 
and provides a means for receiving the sequentially arranged media data elements from the 
file based media source and storing those data elements in the FIFO buffer. The buffer 
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manager comprises means for: receiving the media data; supplying media data in order to the 
FIFO buffer; supplying the FIFO buffer with a predetermined number of data elements at a 
constant time-sequenced fill rate; maintaining a pointer into the buffer for each user 
con[5)uter indicating the last media data element that has been sent to that user, thus 
5 indicating the next element or elements to be sent; and, once the FIFO buffer is full, deleting 
the oldest data element in the buffer as each new data element is received, said means 
arranged to maintain the pre-determined number of data elements in the FIFO buffer. The 
server buffer manager, or a separate process on the server, or a process on another computer 
having access to the file based media data, provides for reading the media data file and 

10 making available to the FIFO buffer sequentially arranged media data elements. At least one 
user computer is connected to the server via the Internet. 

The user computer is associated with a media player software incorporating a user 
buffer and con?)rises means for receiving and storing a predetermined number of media data 
elements which are received sequentially by the media player, playing the data out 

15 sequentially as audio and/or video, and deleting media data elements from the buffer as they 
are played out. As data is played out, the next sequential data elements are received from the 
server in such a fashion as to approximately maintain the predetermined number of data 
elements in the user's buffer. 

In another embodiment, the server is connected to the Intemet and provisioned as 

20 initially described. The server buffer manager, or the media source, provides for sequentially 
numbering the media data elements. The server buffer manager does not maintain a pointer 
into the server buffer for each user. Instead, the media player buffer manager in the user 
computer maintains a record of the serial number of the last data element that has been 
received. Via the use of standard data communications protocol techniques such as TCP, the 
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user computer transmits a request to the server to send one or more data elements, specifying 
the serial numbers of the data elements. The server responds by sending the requested data 
elements, and depends upon the reliable transmission protocol to assure delivery. The user 
computer then continues with additional data requests for the duration of playing the 
5 audio/video material In this manner, the user computer, not the server, maintams the record 
of the highest data element number stored in the user computer buffer. The media data will 
be transmitted to the user computer as fast as the data connection between the user computer 
and the server will allow. As before, the server provides a buffer manager and a FIFO buffer, 
and provides a means for receiving the sequentially numbered media data elements from a 

10 broadcast media source or a file based media source, and storing those data elements in the 
FIFO buffer. The buffer manager coir5)rises means for: receiving the media data; supplying 
media data in order to the FIFO buffer; supplying the FIFO buffer with a predetermined 
number of data elements at a constant time-sequenced fill rate; and, once the FIFO buffer is 
full, deleting the oldest data element in the buffer as each new data element is received. Such 

15 means is arranged to maintain the pre-determined number of data elements in the FIFO 
buffer. At least one user computer is connected to the server via the Internet. 

The user computer is associated with a media player software incorporating a user 
buffer and comprises means for receiving and storing a predetermined number of media data 
elements which are received sequentially by the media player, playing the data out 

20 sequentially as audio and/or video, and deleting media data elements from the buffer as they 
are played out. As data is played out, the next sequential data elements are requested from 
the server in such a fashion as to approximately maintain tiie predetermined number of data 
elements in the user's buffer. 
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In yet another embodiment, the invention provides a method for distributing from a 
server via the Internet streaming media composed of a plurality of time-sequenced data 
elements. A predetermined number of the data elements are sequentially loaded into a FIFO 
buffer. Additional data elements continue to be received on a constant time basis. As each 
S new data element is input to the buffer, the oldest data element is deleted from the buffer, 
maintaining in the buffer the same predetermined number of data elements. At the request of 
a user computer for connection to a media stream, a group of the data elements is 
sequentially sent via the Internet from the FIFO buffer to the user computer connected to the 
Internet. Upon being received by the user computer, the sent group of data elements is 

10 loaded into a user's buffer associated with the user computer. The users computer 
immediately begins to play the audio/video streaming media material. The server continues 
to send the next data elements in sequence until the contents of the FIFO buffer have been 
sent. The data elements are sent by the server as fast as the connection between the server 
and user computer will allow. Once the contents of the FIFO buffer have been sent to a user 

15 computer, as each new data element is received into the FIFO buffer it is immediately sent to 
the user computer in such a manner as to keep the user computer buffer full. The process 
repeats for substantially the entire time that the audio/video material is played. 

Unlike conventional buffering systems, audio begins to play on the user system as 
soon as the user connection to the audio server is effected and a small amount of data has 

20 been transferred - conventional systems required many seconds of data. Audio/video media 
data is initially transmitted from the server more rapidly than it is played out by the user 
system, until the server buffer has been transferred to the user computer. The user's buffer is 
built up while the audio is playing, and can be restored if it is diminished by data 
transmission interruptions. Advantageously, the system and method of this invention afford 
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faster data transmissions than the playback data rate of the media data. Audio/video data is 
transmitted from the server more rapidly than it is played out by the user system under 
conditions wherein the user's computer buffer is not full. The audio/video data in the user 
buffer accumulates; interruptions in playback due to temporary Internet and modem delays 
5 are avoided. 

Although the preferred embodiment utilizes a reliable transport mechanism to move 
data between the server and the user, alternative embodiments could incorporate this 
invention's buffering system in combination with an unreliable datagram-based transport 
mechanism Hybrid systems, where a combination of this invention's buffering system, and 
10 unreliable datagram based transport mechanisms can also be used.. 



BRIEF DESCRIPTION OF DRAWINGS 
The invention will be more fully understood and further advantages will become 
apparent when reference is had to the following detailed description and the accompanying 
1 5 drawings, in which: 

Fig. 1 is a schematic diagram illustrating the elements of a streaming media buffering 
system in accordance with the present invention; 

Fig* 2 is a schematic diagram of an altemative embodiment of the system shown by 
Fig. 1; and 

20 Fig. 3 is a block diagram illustrating the method of the present invention. 
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DESCRIPTION OP THE PREFERRED EMBODIMENTS 

The present invention relates to a buffering system for streaming media, such as 
audio/video, on the Internet 

In one embodiment, the invention provides a system for distributing via the Internet 
5 streaming media composed of a pluraUty of time-sequenced data elements. As shown in Fig. 
1, the system is provided with a server 12 connected to the Intemet 10 for transmitting the 
streaming media data elements. Associated with the server 12 is a FIFO buffer 14 for storing 
at least one of the data elements for transmission, and a buffer manager 16. Buffer 14 is a 
conventional computer storage mechanism such as a hard disk, as shown for convenience of 

10 illustration, or, preferably, an electronic storage arrangement such as Random Access 
Memory (RAM). The buffer manager 16 is in the form of software or firmware that provides 
means for: receiving the media data; supplying media data in order to the FIFO buffer; 
supplying the buffer 14 with a predetermined number of data elements at a constant time- 
sequenced fill rate; maintaining a pointer 24a through 24n into the buffer, one for each user 

IS computer indicating the last media data element that has been sent to that user, thus 
indicating the next element or elements to be sent; and, once the FIFO buffer is full, deleting 
the oldest data element in the buffer as each new data element is received, said means 
arranged to maintain the pre-determined number of data elements in the FIFO buffer. Buffer 
Manager 16 may also comprise means for: formatting media data according to the 

20 requirements of buffer 14, and for digitizing, encoding, and packetizing the media data. 

There is at least one user computer 18 connected to the server 12 via the Intemet 10. 
A user buffer 20 is associated with the user computer 18. The user buffer 20 is provided 
with means for storing a predetermined number of the data elements. User buffer 20 is a 
conventional computer storage mechanism such as a hard disk, or, preferably, an electronic 
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storage arrangement such as Random Access Memory (RAM) as suggested by the 
illustration. A buffer manager 22 is associated with the user computer 18. The buffer 
manager 22, having the form of software or firmware, is provided with means for receiving 
and storing a predetermined number of media data elements which are received sequentially 
S by the media player, playing the data out sequentially as audio and/or video, and deleting 
media data elements from the buffer as they are played out 

The media may come from a live source, shown as 26 in Fig. 1, or from a stored file 
on the server 12, or another storage device, such as a hard drive. For broadcast media, as the 
term is used herein, such as an announcer speaking into a microphone, or playing a CD, the 

10 media source 26 can only transmit audio/video data as fast as it is generated. If the media 
source is file based, such as a music clip stored as a disk file, and if that disk file is stored on 
the server or an associated server con5)uter, this connection could be considered to be near 
instantaneous. In this case, rather than audio/video data filling and depleting the buffer 14, 
an amount of audio/video data equivalent to the desired buffer size is logically constituted as 

1 5 a FIFO buffer. Such a construct is commonly called a data window. The data window moves 
on a time-sequenced basis through the media data file, thus defining the contents of the 
buffer on a moment-by-moment basis and performing the equivalent functions to receiving a 
new data element and deleting the oldest data element. 

The server 12 maintains a buffer of audio/video data comprising an amount adequate 

20 to bridge gaps typical of Internet and modem delays to the user. Preferably, this buffer holds 
enough data elements for about one minute of play. The server buffer 14 is filled the first 
time the media source connection is established or a disk file is read, and before any users 
are allowed to connect to the server 12. 
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Connections from ttie server 12 through the Internet 10 commonly are much faster 
than the data rate required for audio or video playback. This fact is insignificant for 
conventional servers because, not having a FIFO buffer or a buffer pointer for each user, 
audio/video data can only be sent as fast as it becomes available, or as fast as the pace at 
5 which it must be delivered to the user in order to be properly replayed. The user, typically 
interacting with "media player" software on their computer, selects an audio source requiring 
a data rate slower than that available by the user's connection to the Internet. For example, if 
the user's connection to the Internet is made via a 56,000 bits per second modem, the user 
might select a media source encoded for playback at 24,000 bits per second. 

10 With the present invention, as soon as a user connects to the server 12, the server 12 

transmits audio/video data as sequential data elements from its buffer 14 to the buffer 20 of 
the user as fast as the data connection will allow. Unlike the prior art, media begins to play 
on the user computer 18 as soon as the user connection is made to the audio server 12 and a 
minimal amount of data elements have been received and stored in the user's buffer 20. The 

15 user's buffer 20 is built up while the media is playing. As each data element is played, it is 
deleted from the user's buffer 20. Initially, the user buffer manager 22 requests the server 12 
to send media data elements to start the playback stream, such as by selecting a radio station 
from a list The server 12 responds by sending data elements to the user computer 18 as fast 
as it can, until the entire FIFO buffer 14 has been sent to the user computer. Upon receipt of 

20 the initial data elements, the user buffer manager 22 begins playback. Because this is a 
synchronous system with the source, server, and user computer operating by the same 
playback clock rate as determined by the encoding rate of the media, as each data element is 
played out and is deleted from the user buffer 20, another data element has been deposited 
into the server buffer 14 and is available to be sent to the user computer. Server 12 sends the 



19 

newly available data elements as fast as the data rate of ttie connection between server 12 
and user computer 1 8 will allow. 

Since the connection from the Internet to the user is faster than that required for 
media playback, audio/video data is transmitted from the server faster than it is played out by 
5 the user system, thus building up audio/video data in the user buffer. For example, if the 
user's connection to the Internet is at 56,000 bits per second, and the data rate encoded for 
the media to be played is 24,000 bits per second, the buffer level of the user buffer 20 will 
fill at the rate of 32,000 bits per second (56,000 bits per second receive rate, minus 24,000 
bits per second playout depletion rate). 

10 If, for example, the server buffer 14 held one minute of audio/video data, eventually 

the user buffer 20 will hold one minute of audio/video data. The effect is that, over a brief 
period of time, the server buffer 14, or a designated portion of it, is transferred to the user 
buffer 20. The number of data elements in the server buffer 14 actually never changes, it 
always maintains one minute of audio/video data. However, for the particular user under 

15 discussion, a copy of all the data held in the buffer has been sent to the user. Since the user 
buffer 20 now holds one minute of audio/video data, it can play continuously despite data 
reception interruptions of less than a minute, and as soon as the interruption ceases the user 
buffer 20 can begin to rebuild, which will take place as fast as the connection between the 
user computer 18 and the server 12 will allow. The media player can continue to play out the 

20 audio/video material while the user buffer 20 rebuilds. 

The predetermined buffer level in the user buffer 20 may be set at less than the 
predetermined buffer level of the server buffer 14 if desired. For example, the server buffer 
14 might be set to hold one minute of media data, and the user buffer 20 might be set to hold 
thirty seconds of media data. 
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Alternatively, the user computer is replaced by an Internet radio or Internet 
Appliance, which is comprised of a dedicated processor for receiving Internet radio or 
audio/video material. Examples of such devices might range from familiar computing 
devices such as palmtops, PDAs (Portable Digital Assistants), and wireless phones, to 
5 devices that appear and operate similarly to conventional consumer electronic devices such 
as radios and televisions, but with the additional capability of Internet access. 

In another embodiment, as shown in Fig. 2, the media source may be remote from the 
server 12, such as a computer system 28 in a radio station studio. This computer includes a 
source manager 30 which may be implemented in software or firmware. The source manager 

10 30 comprises means for: formatting media data according to the requirements of server 12, 
buffer 14, and buffer manager 16; and, for transmitting that media data to server 12. Source 
manager 30 may further include means for digitizing, encoding, and packetizing the media 
data. Media data typically is generated in real time such as by a speaker talking into a 
microphone or by playing a CD. Generally, computer system 28 transmits media data to 

15 server 12 in real time as the media data is generated. Buffering of media data might occur at 
computer system 28 for convenience of programming, but such buffering is incidental to the 
operation of the end-to-end system being described. Computer system 28 connects via the 
Internet 10, or other suitable data communications medium, to a server 12, wherein server 
buffer manager 16 receives the media data for input into the FIFO buffer 14 as described 

20 previously. Server 12, in turn, transmits the media data to one or more user computers 18, 
also as previously described. 

In another embodiment, shown in Fig. 3, the invention provides a method for 
distributing from a server via the Internet streaming media composed of a plurality of time- 
sequenced data elements. Time-sequenced data elements are generated or received 32. Next, 



